Ensemble Feature Weighting Based on Local Learning and Diversity
نویسندگان
چکیده
Recently, besides the performance, stability (robustness, i.e., variation in feature selection results due to small changes data set) of is received more attention. Ensemble where multiple outputs are combined yield robust without sacrificing performance an effective method for stable selection. In order make further improvements (classification accuracy), diversity regularized ensemble weighting framework presented, which base selector based on local learning with logistic loss its robustness huge irrelevant features and samples. At same time, sample complexity proposed algorithm analyzed VC-theory. The experiments different kinds sets show that can achieve higher accuracy than other ones strategy (such as weighting)
منابع مشابه
Ensemble Feature Weighting Based on Local Learning and Diversity
Recently, besides the performance, the stability (robustness, i.e., the variation in feature selection results due to small changes in the data set) of feature selection is received more attention. Ensemble feature selection where multiple feature selection outputs are combined to yield more robust results without sacrificing the performance is an effective method for stable feature selection. ...
متن کاملEnsemble Learning with Local Diversity
The concept of Diversity is now recognized as a key characteristic of successful ensembles of predictors. In this paper we investigate an algorithm to generate diversity locally in regression ensembles of neural networks, which is based on the idea of imposing a neighborhood relation over the set of learners. In this algorithm each predictor iteratively improves its state considering only infor...
متن کاملClassifier Ensemble Framework: a Diversity Based Approach
Pattern recognition systems are widely used in a host of different fields. Due to some reasons such as lack of knowledge about a method based on which the best classifier is detected for any arbitrary problem, and thanks to significant improvement in accuracy, researchers turn to ensemble methods in almost every task of pattern recognition. Classification as a major task in pattern recognition,...
متن کاملDiversity in Ensemble Feature Selection
Ensembles of learnt models constitute one of the main current directions in machine learning and data mining. Ensembles allow us to achieve higher accuracy, which is often not achievable with single models. It was shown theoretically and experimentally that in order for an ensemble to be effective, it should consist of high-accuracy base classifiers that should have high diversity in their pred...
متن کاملExplaining Diversity in Metagenomic Datasets by Phylogenetic-Based Feature Weighting
Metagenomics is revolutionizing our understanding of microbial communities, showing that their structure and composition have profound effects on the ecosystem and in a variety of health and disease conditions. Despite the flourishing of new analysis methods, current approaches based on statistical comparisons between high-level taxonomic classes often fail to identify the microbial taxa that a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2021
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v26i1.8275